A comparative study of different integrate & fire neurons: spontaneous activity, 
dynamical response, and stimulus-induced correlation 
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Stochastic integrate & fire (IF) neuron models have found widespread applications in computa- 
tional neuroscience. Here we present results on the white-noise-driven perfect, leaky, and quadratic 
IF models, focusing on the spectral statistics (power spectra, cross spectra, and coherence functions) 
in different dynamical regimes (noise-induced and tonic firing regimes with low or moderate noise) . 
We make the models comparable by tuning parameters such that the mean value and the coefficient 
of variation of the interspike interval match for all of them. We find that, under these conditions, 
the power spectrum under white-noise stimulation is often very similar while the response char- 
acteristics, described by the cross spectrum between a fraction of the input noise and the output 
spike train, can differ drastically. We also investigate how the spike trains of two neurons of the 
same kind (e.g. two leaky IF neurons) correlate if they share a common noise input. We show 
that, depending on the dynamical regime, either two quadratic IF models or two leaky IFs are more 
strongly correlated. Our results suggest that, when choosing among simple IF models for network 
simulations, the details of the model have a strong effect on correlation and regularity of the output. 
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I. INTRODUCTION 

Neurons communicate information via short-lasting 
discharges of the electrical potential across their mem- 
brane. The excitability mechanism by which these spikes 
are generated relies on the dynamics of voltage-gated ion 
channels in the neural membrane and is well understood 
P, [2|. To study the dynamics of large neural networks, a 
detailed description of the single neuron's dynamics, al- 
though in principle possible, is impractical and one must 
resort to simpler models of neural spike generation gov- 
erned by only one or two dynamical variables per neuron 
3]. In particular in stochastic versions, that take into ac- 
count the large variability of neural spiking, these models 
can be also helpful to study basic aspects of signal trans- 
mission by single neurons. 

One class of commonly used simplified models com- 
prises integrate & fire (IF) neurons with white noise cur- 
rent. In IF models a spike is generated if the voltage 
reaches a firing threshold (inducing also a reset of the 
voltage); the voltage obeys the one-dimensional dynam- 



ic = f(v) + s(t) +ii + V2D£(t) 



(1) 



where s(t) is a time-dependent stimulus while \i and D 
are the mean and the noise intensity of the input current 
is white Gaussian noise). Variants of the model dif- 
fer by the function f(v). A fine-tuned choice of f(v) may 
permit a rather accurate prediction of both experimental 
subthreshold voltage fluctuations and spike statistics un- 
der noisy stimulation in vitro and in vivo (see [H, [H, [6|, 0, H| 
for some recent convincing examples) . Simple choices like 
a constant, linear, or quadratic function leading to the 
perfect (PIF), leaky (LIF), or quadratic (QIF) model, 
respectively, allow for an analytical calculation of one or 
the other spike statistics and may be also numerically 
simpler to simulate in large-scale networks. Models like 
Eq. (JTJ) have been used in analytical studies of (i) condi- 
tions for asynchronous or oscillatory activity in recurrent 
networks M , flOL fTTL |T2l| : (ii) the transmission of rapid sig- 
nals [l3l I15U16I]; liii) the variability of spontaneous 



activity [13, [H, O, [20]; (iy) noise-induced resonances 
in the spontaneous activity [19L [2l| , and in the response 
to external stimuli [H, [22]; and (v) oscillations in re- 
current networks induced by spatially correlated stimuli 
[23, El El , to name but a few. 

Most of the phenomena studied depend strongly on 
the choice of f(v). As an example, consider the effect of 
coherence resonance, which refers to the existence of an 
optimal noise intensity D that maximizes the regularity 
of the spike train, seen, for instance, as a minimum of 
the coefficient of variation (CV) vs noise intensity: only 
the lea ky JT9L [2l| but not the perfect or quadratic IF 
models 20] show such a minimum. It has, furthermore, 
been shown that LIF and QIF differ strongly in their re- 
sponse to fast (high-frequency) periodic signals [H, [H| . 
Despite these discussions, however, a systematic compar- 
ison among the commonly used IF models is still missing. 
In this paper, we want to fill this gap. 

If one wishes to compare different IF models, the first 
question is how the input parameters \i and D should be 
chosen in the respective model. Already the most ba- 
sic firing statistics of a certain IF model, the firing rate 
(quantifying the spike train's intensity) and the interspike 
interval's coefficient of variation (characterizing the vari- 
ability of the spiking) depend strongly and in a model- 
specific way on fi and D [S pi El ES El ■ The authors 
have recently shown that this basic firing statistics, i.e. 
rate and CV, determine uniquely the input parameters 
fi and D for the three most common IF models men- 
tioned above (perfect, leaky, and quadratic IF neurons). 
This offers a natural way of unambiguously defining fir- 
ing regimes for these models. Moreover, setting the firing 
regime by means of prescribing rate and CV allows for a 
fair comparison of the higher-order statistics of different 
IF models. In this way, we can, for example, consider an 
LIF neuron and a QIF neuron that both show a moder- 
ate firing rate (e.g. 10Hz) and medium variability (say, 
a CV of about 0.5) and compare how these two neurons 
differ in their spontaneous and driven activity. This ap- 
proach of assuming the same basic firing statistics and 
comparing higher-order statistics is complementary to a 
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previous set-up which was entirely based on the firing 
rate dependence on input current [15| . 

What is the most important output statistics of noisy 
IF neurons once the firing rate and CV are fixed? In most 
of the above analytical approaches, two single-neuron 
characteristics appear to be essential: (i) the spike train 
power spectrum of spontaneous activity and (ii) the re- 
sponse to weak stimuli (e.g. to a weak periodic signal 
s(t) = scos(u)t)). In a more recent theory of recurrent 
networks [251 ] . the knowledge of a third simple property 
is needed that goes beyond the properties of a single neu- 
ron: the degree of correlations that can be induced in two 
uncoupled neurons that share some common noisy stim- 
ulus. This latter property has attracted attention of its 
own and has been recently studied experimentally (see 
[23] and references therein) and theoretically [2!, [23, l30l ] 
in particular in the limit of a weak input correlation. 

In the present paper, we study the spontaneous power 
spectrum, the linear response function (susceptibility), 
and the two-neuron correlations induced by a common 
stimulus for the perfect, leaky, and quadratic IF models 
and a variety of firing regimes. In section[TTl we introduce 
the three I F m odels studied and define the firing regimes. 
In section IIII[ we present results on spontaneous activ- 
ity of single neurons. We show that typically IF neurons 
present similar power spec tra when they are in the same 
firing regime. In section IIVI we study the dynamical 
response of single neurons. We recover characteristic dif- 
ferences between the susceptibility of the LIF and QIF 
discussed previously (see, e.g. [Ufl), as well as between 
LIF and PIF [3l| , and show in addition that the spectral 
coherence between spike train and external signal is basi- 
cally low-pass for all three models. Section [V] is devoted 
to the study of two neurons driven in part by common 
noise. In this case, linear response theory leads to a good 
approximation for the cross-spectra between the two out- 
put spike trains when the common noise makes up only 
a small fraction of the total noise. Coherence functions 
of the two output spike trains are again low-pass and 
resemble qualitatively the input-output coherence func- 
tions discussed before. Finally, we discuss the correlation 
coefficient of the spike count for the LIF and QIF models 
for a weak common noise and show analytically in the 
appendix that this correlation coefficient is equal to the 
input correlation for the PIF model. We su mma rize our 
results and draw some conclusions in section PVTl 



II. MODELS AND FIRING REGIMES 

A. Integrate-and-fire neuron models 

In this paper we consider IF neurons subjected to 
stochastic voltage-independent input current, i.e., addi- 
tive white Gaussian noise which can be justified in the 
so-called diffusion approximation [21, EE EH- We will 
consider exclusively models driven by white noise, setting 
the term s(t) in Eq. |T]) to zero; a fraction of the input 
noise will later be regarded as a stimulus or as common 
noise. 

For a leaky integrate-and-fire neuron, the current bal- 
ance equation reads 

C m V = -g L (y-V L )+fi+\/2DZ(t), (2) 
if V(t) = Vth then spike at t; = t k V ->• V r 



where C m is the capacitance of the cell membrane, ql 
and Vl are leak conductance and leak reversal potential, 
respectively, and jl and D are the mean and the intensity 
of the white Gaussian input noise current. The second 
line describes the fire-and-reset rule upon reaching the 
threshold Vth- 

With the simple transformation v = (V — Vh)l^th — 
V r ) and the new parameters r m = C m /gL (membrane 
time constant), /i = Ji/gLi and D = D/g L , this reads 

r m v = -v + n+V25£(t), (3) 

if v(t) = vth then spike at t% = t & v — > v r 

where the threshold and reset are now at v t h = 1 and 
v r = 0. When measuring time in multiples of the mem- 
brane time constant, i.e. t = t/r m , this model is equiva- 
lent to Eq. fl} with a rescaled noise intensity D = D/T m 

and with f(v) — —v. Note that /i + v / 2~D£(i) in this 
rescaled model has not the physical dimensions of an 
electric current anymore and that is why we will refer 
to it here with the more general term 'input'. 

If the leak term gi,(V — Vl) is small compared to the 
mean input current, we may be justified to neglect it. All 
previous transformations can be repeated (including the 
division by the leak conductance gL,) and thus we end up 
with 

Tm v = fi + V2£>£(t), (4) 

if v(t) = vth then spike at t, = t & »->» r 

which corresponds after rescaling of time again to Eq. ([1]) 
but this time with f(v) = 0. This is the perfect integrate- 
and-fire (PIF) model with white noise (als o known as 
random- walk model of neural firing) [32|, OJ] . 

If the noise-free neuron is close to a dynamical bi- 
furcation, specifically, close to a saddle-node bifurca- 
tion from quiescence to tonic firing, another form of the 
integrate-and-fire neu ron contains a quadratic nonlinear- 

ity [ilCESGSESESEl 

C m V = a(V - Vo) 2 + fi + V2Dt(t), (5) 

if V(t) = oo then spike at tj = t & V — > — oo 

In this case one chooses threshold and reset at infinity 
because the slow dynamics in V makes the exact (large 
but finite) values of V r and Vth irrelevant. Note also 
that V in this case can be but has not to be a voltage 
- in general, it is the variable of the center manifold 
[38j ] : correspondingly, the factor C m on the left-hand- 
side can be taken as a convention. For infinite reset and 
threshold values, this dynamics can be brought into a 
simplified standard form by choosing a new variable v = 

a(V — Vo)/gL and new parameters /i = ap/g L and D = 
Da*/gi: 

r m v = v 2 +n+ V25{(t), (6) 
if v(t) — oo then spike at tj = t & v — > oo 

which corresponds in rescaled time t — t/r m and noise 
intensity D = D/r m to Eq. (QJ with f(v) = v 2 . In simu- 
lations of this standard form of this quadratic integrate- 
and-fire neuron (QIF), one uses large but finite threshold 
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and reset such that - by further increasing their values - 
the results (ISI statistics, spike train power spectra, etc.) 
do not change anymore within the desired accuracy (say, 
curves do not change in line thickness). For the effect 
of finite values of reset and threshold values on the 1S1 
statistics, see [20l |. 

Note that both in the PIF and the QIF the intro- 
duction of the membrane time scale is arbitrary — we 
could equally well compare to PIF and QIF models in 
which t to would be replaced by a multiple or a fraction 
of this time (changing then also the input parameters, of 
course). The choice of r m has been made previously for 
the PIF [44| and we follow here this convention also for 
the QIF. 

Our approach of comparing different IF models here 
is complementary to others in which the input current 
is assumed to be known and the parameters of the spe- 
cific models (e.g. Eq. |J5J| and Eq. (O) are fitted to yield 
a given ISI statistics. Here we start with the standard 
models Eq. ©, Eq. @, and Eq. © and ask for the in- 
put parameters that yield a given rate (in units of the 
inverse membrane time constant) and a given CV. Al- 
though this may seem to be unusual in an experimental 
situation where one has control over the input current, 
it appears to be a reasonable approach in vivo where the 
effective input current and its noise intensity is set by the 
synaptic background and thus unknown. 



B. Firing regimes 

In order to make different IF models comparable, we 
must first specify the correspondence between their pa- 
rameters. For instance, in a comparison between LIF 
and QIF, we should first decide which pair (D, ji) for the 
first model corresponds to which pair (D,fj) for the sec- 
ond. Here we do this by defining different firing regimes 
in terms of fixed rate and coefficient of variation of the 
spike trains. In order words, D and \x in different models 
are chosen as to yield a given firing rate 



1.2 r 



1 

T - (T) 

and a given coefficient of variation 



R = 



V(T 2 ) - W 
(T) 



(7) 



(8) 



where T is the interspike interval. Throughout this paper 
(•) denotes averaging over realizations of the stochastic 
process. Note that, since time is measured in units of 
the membrane time constant, all the rates are in units 
of the inverse of this constant. For instance, for a mem- 
brane time constant of 10ms, a nondimensional rate of 1 
corresponds to 100Hz. 

The pair of parameters (D, ji) for a given model that 
yields a certain regime is therefore determined by the 
intersection between one countour line for the rate and 
one contour line for the CV. However, it is not clear a 
priori whether at most one such intersection exists. This 
problem was recently addressed by us [2S|. We showed 
that, given fixed rate and CV, there can be at most one 
associated pair (D,fi) for the three IF models studied in 
this paper. 
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FIG. 1: Contour lines for rate (black) and CV (gray) in 
parameter space for the different models. Regimes A-I are 
defined by intersections of these contour lines. 



Fig. Q] displays some contour lines for the rate and CV 
for the three models considered here. There are different 
ways to determine these contour lines. They can be ob- 
tained analytically (see 39}). Here we h ave de termined 
them numerically, as explained in section fill Bl In Fig. [T] 
we also define 9 specific regimes, labeled A-I, which we 
study in some detail here. The corresponding values for 
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the rate and CV in these regimes are: 



Regime 


A 


B 


C 


D 


E 


F 


G 


H 


I 


rate 


1 


1 


1 


0.7 


0.7 


0.7 


0.4 


0.4 


0.1 


CV 


0.1 


0.3 


0.5 


0.1 


0.3 


0.5 


0.3 


0.5 


0.7 



III. SINGLE NEURONS: SPONTANEOUS 
ACTIVITY 

A. Measures 

The output spike train y can be modelled as a sum 
of delta peaks at the time instants when the voltage de- 
scribed by Eq. {1} reaches the threshold value: 



/(*) = $>(*-*;). 



(9) 



where tj is the instant when the j-th spike occurs. 

The spontaneous activity of the IF neurons studied 
here corresponds to a renewal point process. Each in- 
terspike interval is an independent random variable. In 
processes of this type, all the information on the statistics 
is contained in the probability density of the 1ST 

In this paper, we will quantify the neuron's correlation 
statistics by means of power and cross-spectra. We start 
by defining the Fourier transform of the zero-average 
spike train as: 



y(f)= / dt'e^'ivit') - <y(f)». 



(10) 



The power spectrum of the spike train will be the quan- 
tity used in this paper to characterize the spontaneous 
activity of the IF neurons. It is given by: 



Sy{f) 



lira — (vv* 



(11) 



where T is the realization time window. For renewal 
point processes, the relation between the power spectrum 
of the spike train and the Fourier transform of the prob- 
ability density of the ISI, F(f), is given by [4Cj |: 



Sy(f) = 



1 1-|^(/)| 2 

(T) |1 — F(f)\ 2 



(12) 



We note that analytical expressions for F(f) are known in 
the cases of PIF and LIF (equivalently, often the Laplace 
transform is stated that yields the Fourier transform for 
a negative imaginary argument). In this work, we will 
only use that for the PIF, which is given by 31. 141IJ: 



F( PIF >(/)=exp 
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FIG. 2: Power spectra of the spike trains for the three models 
in the nine firing regimes defined in Fig. 1. 



B. Results 

In Fig. [21 we show the power spectra for the three mod- 
els in regimes A-I. These spectra were obtained analyti- 
cally via Eqs. (|12p and (fT3"|) for the PIF and numerically 
for LIF and QIF using the algorithm recently introduced 
by Richardson [22]. We observe that the power spectra 
of different models in the same regime are in general very 
similar. In Regimes A and D, which are characterized by 
low variability (CV equal to 0.1), the power spectra vir- 
tually coincide. In the other regimes, the power spectra 
coincide in the limits of low and large frequencies, and de- 
viate to some extent in the intermediate-frequency range. 

The coincidence of the power spectra for different mod- 
els in the same regime in the low and large frequency lim- 
its is not surprising. In fact, for renewal point processes 
one can show 40] that: 



lim S v (f) = rR 2 



and 



lim S y (f)=r. 



(14) 



(15) 



Since each regime i s de fined by fi xin g the rate and CV, we 
conclude from Eq. (|14p and Eq. (fTS"]) that the power spec- 
tra for different models should indeed coincide in these 
limits. In fact, we have used these relations and the above 
mentioned algorithm for the numerical determination of 
the power spectrum [42| ] to obtain the contour lines dis- 
played in Fig. [TJ 

To quantify the differences between the power spectra 
of different models, wc define the maximal relative differ- 
ence AS^' k between the power spectra of models j and k 



5 



(a) 
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D(LIF) 
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1 10 100 
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model, i.e., for large n and small D [cf. Fig. [3ja) and 
fb)]. Second, when comparing the LIF with the QIF 
(Fig-E^c)), we conclude that the power spectra of these 
models are practically coincident if the noise intensity is 
small and their relative difference increases with D, dis- 
playing moderate differences for very large noise inten- 
sity. There is a nontrivial dependence on /i as well, but 
the dependence on D is the dominant one. Remarkably, 
this rule of thumb whereby the power spectra differences 
between LIF and QIF increase with the noise intensity 
is valid for both tonic (^Qip > 0) and noise-induced 

(/iQjp < 0) firing regimes. 



IV. SINGLE NEURONS: DYNAMICAL 
RESPONSE 

A. Measures 

In this section, we are interested in the response of 
single neurons to a small stimulus. This can be accom- 
plished in several ways, e.g., by adding a small term with 
sinusoidal time dependence to Eq. {1} . Alternatively, and 
this is the procedure adopted here, one can regard a frac- 
tion of the noise term in Eq. (fT]) as the external stimulus. 
This choice will allow for a straightforward connection 
between the single neuron's response presented in this 
section and two-neuron correlations under common noise 
discussed in section IVl We thus rewrite Eq. ([T]) as: 



(c) 




1 10 100 

D (QIF) 



FIG. 3: (Color online) Maximal (over all frequencies) relative 

difference of power spectra AS^ F ' (a), AS^^'^^ (b), 

and AS^ F (c). The contour lines for rate and CV are 
the same as those depicted in Fig. 1. 



v = f(v) + p + ^2(1 - c)D£i(t) + V2^£ c (i), (17) 

where the noise terms £j(t) and £ c (i) are white Gaussian 
and described by: 

(Ut)ut')) = mMt'))=s(t-t'), (is) 

and c (playing the role of a relative signal amplitude) is 
a number between and 1. Wh en a ddressing the single 
neuron's response, we read Eq. (jTTJ) as describing a cer- 
tain neuron subjected to intrinsic noise y2(l — c)D^i(t) 
and driven by an external (noisy) stimulus: 

s(t) = V2cDi c {t). (19) 

To characterize the neuron's response to the stimulus, 
we use the cross-spectrum between the spike train y and 
the stimulus s(t), 



over all frequencies as: 

AS «* - (#ri^) ■ (16) 

In Fig. m we plot A5f IF ' LIF , AS PIF ' QIF , and 

AS fF ^ F,< ^^ F . The first observation we make is that the 
power spectra of the PIF matches those of the LIF and 
QIF in the parameter regions where the PIF is a good 



S ys (f) = lim -<P*>, (20) 

1 — >0O 1 

and the coherence function with respect to s, 

7 2 (/) = (21) 

where S s = 2cD is the power spectrum of s. One should 
note that the coherence function is restricted to the in- 
terval < 7 2 (/) < 1. 
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B. Single neuron's response 



The cross-spectra (|20| can be calculated, for small c, 
from linear response theory. The idea is to consider the 
term y2cD^ c as a small perturbation of the term fi in 
the stochastic system 



f(v)+n+y/2(l-c)DSi(t). 



(22) 



This does not seem feasible at first sight, since £ c has 
infinitely large variance. To show that linear response 
can be applied in this case, we formally consider £ c as a 
band pass white noise with flat spectrum of height 2cD 
and cutoff frequency fmax- Its variance is then equal to 
2cDf rnax . This variance can be kept small even in the 
limit of fmax - > oo (white noise) if we impose that c 
decreases sufficiently fast, i.e., c <C ^/2Df max . There- 
fore £ c can be indeed considered a small perturbation. 
Linear response theory [43| then leads to the following 
approximation: 



(y(/)> = xoAD^DUf), 



(23) 



where xd,h is the susceptibility of the system which can 
be estimated from the cross spectrum between input sig- 
nal and spike train via the well-known relation 



S ys (f) _ Hm r ^c (<£v / 2^DCkk 



2cD 



2cD 



(24) 



Closed analytical forms for \ exist for the PIF [44| and 
LIF [13, Q3] , and are given respectively by: 



Xpif 



At 2 1 - yl - SnifD/y? 
v t h - v r imfD 



and 



Xlif 



r27ri//v A D X>27r,; /- 1 



( fi-vth \ 

V Vd ) 



2-nif-l 



(25) 



2irif - 1 r, / ii-v th \ _ e s-r,„ ... ( »-v r \ 



where the rate r for the LIF is given by 
r{fx,D) = 



t / dze z erfc(z) 

(p-v th )/V2D , 



the abbreviation S reads 



2fi{v th - v r ) 



4D 



(26) 
(27) 

(28) 



and T> a (z) is the parabolic cylinder function [45]. For 
the QIF, x can be obtained numerically from the Fokker- 
Planck equation [46j |. 
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FIG. 4: Gain (|x|) as a function of frequency for the three 
models in the Regimes A-I. 
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FIG. 5: Phase lag of the linear response (i.e. — arg(|x])) as a 
function of frequency for the three models in the Regimes A-I. 
Due to numerical constraints, the phase of the QIF model is 
not shown in the large frequency range, where it asymptotes 
to 180°. 



C. Results 

Since Eq. ([24| is valid for arbitrary c, the cross- 
spectrum S ys is fully characterized by the susceptibility 
Xd.h- We have studied the susceptibility for the three 
models in regimes A-I. The susceptibility for the PIF was 



determined using Eq. (I25| . while the susceptibility for the 
LIF and QIF was determined by integrating the Fokker- 
Planck equation with the algorithm presented in [42l . I46j ] . 
It turns out that this num erical integration is faster than 
the evaluation of Eq. (|26|) using standard softwares. 
In Fig. 21 we show the gain \x\ as a function of the fre- 
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quency for the three models in Regimes A-I. The gain is 
typically larger for the LIF and is in all regimes at least 
one order of magnitude smaller for the QIF. In regimes 
A and D, where the firing is most regular, the gain dis- 
plays peaks for the LIF (close to the firing frequency and 
its higher harmonics) and QIF (only close to its firing 
frequency) but not for the PIF. As observed in [15|], in 
the large frequency limit the gain decays as a power law 
with exponent 0.5 for the LIF and 2 for the QIF. From 
Eq. (f25|) . we see that the exponent for the PIF is also 0.5. 

In Fig.[5l we display the phase <f> for the different mod- 
els. It is defined such that \ — \x\ e ^- F° r the PIF, it 
is in all regimes close to zero for small frequencies and 
increases monotonically. Its saturation value, attained in 
the limit / — > oo, is <fi = 45°. Except for the limits of 
small and large frequencies, the behavior of the LIF can 
be markedly different. In particular in Regimes A and 
D, the phase oscillates around zero in a certain range 
enclosing the eigenfrequency. It first becomes negative. 
Close to the eigenfrequency it changes signal, and repeats 
this oscillatory behavior a few times before approaching 
its asymptotic value of 45°. Finally, the behavior of the 
phase for the QIF is similar to the one of the LIF, except 
that the asymptotic value at large frequencies is remark- 
ably larger - equal to 180°. The asymptotic behaviors for 
the LIF and QIF were also discussed in [TBI ]. 




ur icT 1 io° io 1 io 2 io 2 10 J io° io' io 2 i(T io~' io° io' io 2 




ur io"' io° io' io~ 2 io ' io" io' io~ 2 io"' io° io' 




FIG. 6: Coherence function 7 2 for the three models in the 
Regimes A-I. Note that, in Regime I, the coherence of the 
QIF is larger than that of LIF for small frequencies. 

We now turn to the coherence function -f 2 that we 
show in multiples of c for the different models in Fig. [5] 
Although the gain of the three models differed by more 
than one order of magnitude and showed different reso- 
nances, their coherence functions are rather similar and 
display a low-pass behavior. Therefore PIF, LIF, and 
QIF transmit most information in a low-frequency band 
of the stimulus. Going to the limit of vanishing frequen- 
cies, the PIF will transmit most information: as can be 



explicitely shown [31| . 7 2 for the PIF approaches the 
maximum value c in the limit of zero frequency, a fea- 
ture not shared by neither LIF nor QIF. Furthermore, 
the coherence function at low frequencies can be larger 
for the LIF as compared to the QIF (regimes A-H) and, 
conversely, larger for the QIF as compared to the LIF 
(regime I). As we will argue in the next section, this fea- 
ture also affects which of these models will display larger 
two- neuron correlations under common noise stimulus. 



V. TWO-NEURON CORRELATIONS UNDER 
COMMON STIMULUS 

A. Measures 

We now study two neurons of the same model sub- 
jected to individual noise and also to common noise. For 
this purpose we consider the following modification of 
Eq. dm): 

«i = /(«<) + M + V2(l - c)D£i(t) + V2ti5£ c {t), (29) 

where the subscript i stands for the n eur on's index and 
can attain the values 1 and 2. Eqs. (fl"8|) remain valid, 
and we now also have: 

(MW)> = o. (so) 

To characterize the correlations between the output 
spike trains of two different neurons, we will use their 
cross-spectrum, 

S viV2(f) = (31) 

T— i-oo 1 

and their coherence function, 

T 2 {f)= \^l_ (32) 

Another important measure of correlation between two 
spike trains is the correlation coefficient of the spike 
count. The spike counts n\ and n% are the numbers of 
spikes elicited by neurons 1 and 2, respectively, over a 
time window of length T. Their correlation coefficient is 
defined as: 

= (nin 2 ) ~ (ni) (n 2 ) 

VW) - W) V(«i> - 

and its range lies between -1 and 1. In the important 
limit of large time windows, one can prove the following 
relation between this correlation coefficient and the zero 
frequency values of the cross- and power-spectra of the 
spike train [28j |: 

p = lim PT = lim - g ^C0 (34) 



B. Small input correlation 



Regime C 
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We now calculate S yiV2 (/) in the case of small c. Using 
Eq. ([221), we obtain: 

S yiy2 {f) = lim ^(((yi2/2>?i)?2>« c = 

1 — >oo 1 



lim -={{$1) & 

1 — >oc 1 



(35) 



where the averages were taken first over £i (with frozen 
£2 and £ c ), then over £2 (w ith frozen £ c ), and finally over 
realizations of £ c . Eq. (|35p has been already used in the 
literature [H,[25|. 

Since the limit of \ at zero frequency is given by 4^ , 
for small input correlation Eq. (|34[) has the simple form 



2cD 



P = 



-R 2 



(36) 



Eqs. |gT}, ([Ml), ((111), and (J2SJ) imply that, for small 
c, the correlation coefficient of the spike count is equal 
to the limit value of the coherence function 7 2 at zero 
frequency. 



C. Results 

Our analysis of the two-neuron correlation relies pri- 
marily on s imu lations of the stochastic differential equa- 
tions (Eq . ([29]) ) and the evaluation of the cross-spectra 
(Eq. (|31 [) ). This is computationally considerably more 
demanding than the simple integration of the Fokker- 
Planck equation and the evaluation of the analytical ex- 
pressions leading to the results presented in the previous 
sections. For this reason we now restrict ourselves to the 
analysis of regimes C and I only. However, this suffices 
to lead us to three important conclusions, which we now 
state. First, as Figs. [7] and [8] show, linear response the- 
ory leads to good approximations for the cross-spectra 
S,n, ln for small c (e.g., c=0.f). Second, we note from 

the 



jy x yn for small c (e.g 

Fig. El that, as the input correlation c approaches 1 



convergence of S yiy2 to S y and of T 2 (/) to the maxi- 
mum value 1 (for all /) is very slow. This convergence 
is more pronouncedly slow for large frequencies, which 
corresponds to the fact that a tiny amount of individ- 
ual noise is enough to produce a finite difference in the 
spiking times of the two neurons. Third, the coherence 
function in the important limit of small frequencies is 
larger for the LIF in regime C as compared to the QIF 
and, conversely, larger for the QIF as compared to the 
LIF in regime I. 

In view of the discussion in section IV Al we conclude 
that the correlation coefficient p of the spike count in the 
limit of large time windows is larger for the LIF than for 
the QIF in regime C and larger for the QIF than for the 
LIF in regime I. In Fig. 1 101 this is shown to occur for c 
in the whole range < c < 1. We also observe that an 
approximately linear dependence holds in a fairly broad 
range in Regimes C and I for both models. 
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FIG. 7: Cross-spectra between the two output spike trains of 
neurons under common noise stimulus divided by the input 
correlation c (left panels) and coherence function of the two 
output spike trains divided by c 2 (right panels) in Regime C. 
PIF (black), LIF (dark gray), and QIF (light gray) are com- 
pared. In the left panels, the circles (PIF), squares (LIF), and 
diamonds (QIF) correspond to the prediction from Eq. (|35|l . 



In order to provide a complete picture of the corre- 
lation coefficient not only for two specific regimes but 
rather in a fairl y b road regi on of the parameter space, 
we show in Fig. QT] and Fig. [T2] the ratio p/c as a func- 
tion of p and D for the LIF and QIF, respectively. They 
were estimated on the basis of the Eq. ([5?])) and are ex- 
pected to be correct for small input correlati on c . For 
the LIF, we have calculated the terms in Eq. (|3"6"]) from 
the exact analytical expressions (see e.g. [39|). For the 
QIF we resorted to the numerical algorithm of Rcfs. [46] 
and @2|. 

We note from that for both LIF and QIF the corre- 
lation coefficient falls sharply when the Poissonian firing 
regime (low D and p) is approached. Also remarkable is 
the fact that, at least in the studied parameter regions, 
the correlation coefficient for the LIF can approach 1 (if 
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Regime I 





FIG. 8: Cross-spectra between the two output spike trains of 
neurons under common noise stimulus divided by the input 
correlation c (left panels) and coherence function of the two 
output spike trains divided by c 2 (right panels) in Regime I. 
PIF (black), LIF (dark gray), and QIF (light gray) are com- 
pared. In the left panels, the circles (PIF), squares (LIF), and 
diamonds (QIF) correspond to the prediction from Eq. (|35}. 



p and D are large) , but the correlation coefficient for the 
QIF seems to have a considerably smaller upper bound 
(below 0.7). Let us now describe some simple limits of 
p/c. For the QIF, this quantity approaches the value 
2/3 in the limit of strong input (p > 0) and weak noise 
(D -C 1). In the excitable regime (p < 0) at weak noise 
(D <C |/i| 3 / 2 ), i.e., when the firing is close to Poissonian, 
p/c approaches zero. 

In Fig. 1131 we show the ratio between the correlation 
coefficients of LIF and QIF. The correlation coefficient is 
larger for the LIF in most parts of the analyzed parameter 
space. Only when p and D are small, i.e., when the firing 
is close to Poissonian, is the correlation coefficient larger 
for the QIF than for the LIF. 

Finally we turn to the simplest case of the PIF. For 
this model, one can show that the correlation coefficient 
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FIG. 9: Power- and cross-spectra of the output spike trains 
of two QIF neurons under common noise stimulus (a) and co- 
herence function of the two output spike trains (b) in Regime 
C for c = 1 - e, with e = 10" 3 . 



is g iven simply by c. In the terminology introduced in 
[281] . the correlation susceptibility is equal to 1 for the 
PIF. Using Eq. ||35J), we obtain 



p( PIF ) = lim 



2cD\ X (f)f 



/-° Sy(f) 



(37) 



Using Eqs. (f2"Tj) and (|24[) . as well as the fact that 
lim/_>o7 2 (/) = 1 for the PIF (see (23), we obtain 



,(PIF) 



(38) 



Remarkably, this linear law, in principle valid only for 
small c, can be shown for the PIF to be valid for all 
c G [0, 1], as we show in the Appendix. 




FIG. 10: Correlation coefficient of the spike count vs input 
correlation for large time window for LIF and QIF in hring 
regimes I (a) and C (b). 
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FIG. 11: (Color online) Correlation coefficient (divided by 
c) of the spike counts at large time windows for the LIF as a 
function of both D and fi. 




FIG. 12: (Color online) Correlation coefficient (divided by 
c) of the spike counts at large time windows for the QIF as a 
function of both D and \i. 



VI. CONCLUSIONS 

We have provided an extensive comparison of three 
important IF models in different firing regimes, as de- 
termined by given firing rate and CV. We have shown 
that the spontaneous activity of the LIF and QIF neu- 
rons virtually coincide in regimes characterized by weak 
input noise and deviates moderately for larger values of 
the input noise. The dynamical response behavior, how- 
ever, strongly differs among different models, even in the 
same firing regimes. This was discussed in the limit of 
large stimulus frequencies in [Foj and extended here for 
the entire frequency range. 

An important feature of the single neuron's response 
characteristics is that, depending on the firing regime, 
it can be stronger at a given frequency for the LIF as 
compared to the QIF or the other way around. We have 
shown that this implies, as long as the linear response 
theory holds true (i.e., for small c), that either two LIF 
or two QIF neurons can display larger low-frequency cor- 
relations when driven in part by common noise. Alto- 
gether our findings indicate that the successful use of a 
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FIG. 13: (Color online) Ratio between the correlation co- 
efficients of the spike counts of LIF and QIF in the limit of 
large time windows. The contour lines for rate and CV are 
the same as those depicted in Fig. 1. 



certain IF model to reproduce the spontaneous activity 
of biological neurons does not at all guarantee that the 
correlations in the activity of a population of such neu- 
rons will be also well described. More important for the 
latter are the dynamical response characteristics of the 
single neuron to an external stimulus. 

We have also characterized a large portion of the phys- 
iologically relevant parameter space of the studied IF 
models and concluded that the correlations in the spike 
trains of two LIFs, as characterized by the correlation 
coefficient for the spike count, are in most cases larger 
than the corresponding correlations of two QIFs. An im- 
portant exception, however, exists: when the firing ap- 
proaches the Poissonian regime, the correlations between 
QIF neurons become larger than those of two LIF neu- 
rons. 

It constitutes an interesting open problem to perform 
the same studies as done here for other IF models, e.g. 
the exponential IF model introduced in [15H . Finally, an 
extensive comparison between type I O [20, H3] and type 
II [48|, S3, [5(| neurons as regards to spontaneous activity, 
dynamical response, and two-neuron correlation under 
common stimulus is still lacking and is expected to shed 
light on the problem of how large neuronal populations 
encode and transmit information. 
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APPENDIX A: CORRELATION COEFFICIENT 
FOR THE PIF FOR ARBITRARY c 

Here we show that the correlation coefficient for the 
PIF is for an input correlation c € [0, 1] given by: 

p( PIF ) = c. (Al) 
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For this purpose, we track the non-reset voltage of the 
PIF described by: 



Substituting Eq. (|A5]) in Eg. 
and f3"01). we obtain Eq. Ejt - 



4j) and using Eqs. ([181) 



(A2) 



and observe that, in the limit of large times, the rela- 
tive error in approximating the spike count rii(t) by this 
unresetted voltage Vi(t) approaches zero, i.e.: 



nj(t) - Vj(t) 

tzz, (m(t) + Vi(t))/2 



lim 



0. 



(A3) 



Eq. (|A3|) holds true because the difference between the 
spike count and the non-reset voltage is a number be- 
tween and 1 (assuming vth — v r = 1). In othe r words, 
the numerator appearing in the limit of Eq. (|A3[) remains 
bounded between and 1 for all t, while the denominator 
goes to infinity as t — > oo. 

Approximating the spike count n% (t) by this unresetted 
voltage Vi(t), we obtain an alternative formula for the 
correlation coefficient for the spike count of the PIF: 



p( PIF > = lim -= 



»i(*)«a(t))-(«i(t))<«a(t)> 



(vi(t)) 2 )((v*(t)) 



To calculate the right- hand side of Eq. 
formal solution of Eq. (1A2|) . given by: 



(A4) 
4J), we use the 



Vi (t) = / (ji + vT^c^(t') + Vd; c (t'))dt'. (A5) 
Jo 



APPENDIX B: NUMERICAL METHODS 

The contour lines for the rate for both LIF and QIF, 
as well as the respective power spectra, were obtained by 
resorting to the numerical algorithm of Ref. 42]. For 
the LIF (QIF), the rate and CV were calculated for the 
points on a roughly 2000 x 2000 (10 3 x 10 3 ) grid over 
the (D,fi) region displayed in Fig. 1. The integration 
step for the numerical evaluation of the Fokker-Planck 
equation (see [42|) was equal to 10~ 4 for the LIF and 
10 -3 for the QIF, with the threshold and reset at ±oo 
being numerically replaced by ±500 for the latter. The 
CV was estimated by assuming that the power spectrum 
at a frequency 10 3 times smaller than the firing rate was 
equal to rR 2 (see Eq. (fTJ])) for both LIF and QIF. 

The gain and phase for the linear response of LIF and 
QIF were computed using the algorithm of Ref. [46| , with 
the same integration steps (as well as reset and threshold 
values for the QIF) as above. Finally, the cross-spectra 
S VlV2 were obtained from a fast Fourier transform algo- 
rithm after integrating the stochastic diferential equa- 
tions Eq. (gnj) with a time step of 10~ 3 . For the LIF, 
a correction based on the probability that the voltage 
reached the threshold and decreased below it within the 
time interval dt was implemented (see [5~ll]). 
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